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ABSTRACT 

Nine syllabi for courses on research and evaluation 
in higher education are reviewed. The syllabi fall into four areas: 
general research design and methods, program evaluation, naturalistic 
inquiry, and institutional self-study. A course on research design 
and methods at the University of North Carolina, Chapel Hill, focuses 
on three basic modes of inquiry and requires students to develop a 
research proposal using one of the inquiry modes. A University of 
Arizona course provides students experience with research methods and 
data collection and allows them to begin formative work on a 
dissertation proposal. A Rutgers University course describes the 
sources of control and models for evaluation, self -regulation, 
accreditation, and institutional licensing processes. Also considered 
are research design and methods courses at Ohio State University and 
the University of Michigan; a team-taught research methods course at 
Columbia University; a research methods course at Pennsylvania State 
University; a course in naturalistic inquiry in educational 
administration; two courses in educational program evaluation at the 
University of North Carolina, Chapel Hill; and a course on 
institutional research and planning at the University of Michigan. 
Texts used in the courses are identified. A list of members of the 
course syllabi network is included. (SW) 
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Research/Evaluation Courses in Higher Education 



The ERIC Clearinghouse on Higher Education currently has nine syllabi 
in the area of research/evaluation. These syllabi fall into four distinct 
areas: general research design and methods, program evaluation, 
naturalistic inquiry, and institutional self-study. In the general research 
design and methods category, two have "inquiry" in their title. William 
Loadman (Ohio State) teaches "Introduction to Inquiry" and James Morrison 
(UNC-Chapel Hill) teaches "Logic of Inquiry." Loadman focuses on students 
being able to accurately define and understand basic vocabulary and 
concepts as well as being able to critique and design a study. He uses the 
text by Gary Moore, Developing and Evaluating Educational Research (Little, 
Brown and Company, 1983). Morrison focuses on the three basic modes of 
inquiry (experimental, quasi-experimental, and non-experimental, both 
qualitative and quantitative) and requires each student to develop a 
research proposal using one of the inquiry modes. The proposal draft is 
critiqued in class by two students (all students read all proposals) and 
the instructor. The revised version is submitted for sumative evaluation. 
Critiques are evaluated as to how helpful they are to the author in 
revision. He uses the Orienstein and Phillips text, Understanding Social 
Research and a series of selected journal readings. 

Loadman also teaches another course titled, "Proposal Development" 
which requires students to develop and critique proposals. He uses the 
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Loring and Harold text, Proposal Preparation and Management Handbook 
(Van Nostrand Relnhod Company, 1982). 

In John Blackburn's (Michigan) course on research design and methods, 
the focus is on the logic of the research process and the issues that 
different techniques address. This course serves both students who need 
to know how to interpret research studies or to phrase problems as 
researchable questions and students who intend to be researchers, the 
distinction operationalized in the form of a final for the fir it group and a 
research proposal for the second. As texts, he uses Seiltiz et al. 
(Research Methods in Soci al Relations! . Campbell and Stanley 
(Experimental and Quasi-Experimental Designs for Research! , and Glaser 
and Strauss (The Discove ry of Grounded Theory: Strategics for Quaiitative 
Research). In addition to this course, Michigan students can enroll in a 
research practicum to assist them in preparing a research article suitable 
for publication. 

Richard Anderson and Wagner Thielens (Teachers College, Columbia) 
team teach "Research Methods in Postsecondary Education" using the 
Kidder revision of Sellitz, Wrightsman, and Cook's Research Methods in 
Social Relations. This course introduces students to a range of 
methodologies and their application in higher education so that students 
will have a better understanding of what research is, what methods suit 
their interests and abilities, and what courses they will need to enroll in 
to prepare for their dissertations. The range of methods covers 
experiments, interviews, case studies, surveys, and meta research 
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techniques. Students do not write a proposal, but have a take-home final 
examination. 

Larry Leslie (Arizona) teaches a course titled, "Research in Higher 
Education Administration," which is designed to provide experience with a 
range of research methods and data collection techniques and begin 
formative work on a dissertation proposal. He uses a lecture-discussion 
format including student presentations and class critiques. Each student 
writes seven short (four page) papers and seven critiques of other 
student's papers. He uses the Kerlinger and Campbell and Stanley texts, 
supplemented by a reserve reading list. 

Jim Fairweather (Penn State) teaches what may well be the most 
comprehensive Research ^ethods*course. He begins with a heavy dose of 
reading in the philosophy of science (Kuhn, Shapere, Duhem, Adorno, 
Popper, Dahrendorf, Simon, and Soltis), proceeds through problem 
definition, conceptual frameworks, measurement, instrumentation, and 
data collection, and the three modes of inquiry. He includes discussions of 
path analysis, time series designs, and quantitative methods. Students 
are required to work in small groups to develop, present, and defend 
research designs. The course concludes with students preparing a 
dissertation proposal. 

Naturalistic Inquiry 

Yvonna Lincoln (Kansas) teaches "Naturalistic Inquiry in Educational 
Administration." The purpose cf this course is to introduce students to 
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qualitative methods and develop their skill in using participant and 
non-participant observation, structured and unstructured interviewing, 
unobtrusive measures, document analysis, use of records, and non-verbal 
communication. She also focuses on issues of validity, reliability, 
objectivity and generalizability in qualitative data, use of the case-study 
technique, and ethical problems. Students are required to report their 
experience with these methods, review an exemplar case study, and take 
two examinations. The text for this course, Guba and Lincoln, Effective 
Evaluation, is supplemented by journal readings. 

Program Evaluation 

Two syllabei concern educational program evaluation, both taught at 
the University of North Carolina at Chapel Hill, one by Charles Friedman 
and the other by James Morrison. (Same course title, but one given in the 
fall and one in the spring.) The general objectives of both courses are the 
same, i.e., for students at th<* completion of the course to converse 
fluently on the subject of evaluation and to be able to critique and design 
an evaluation of an educational program. Their means to achieve these 
general goals differ. Although both begin by covering different approaches 
to educational evaluation, Friedman uses a case study method requiring 
students to analyze a competed evaluation study, to analyze a "given" 
study design and complete it, and to design an evaluation for a program 
described in the case. He uses Guba and Lincoln's Effective Evaluation . 
House's Evaluating with Validity , and Popham's Educational Evaluation . 
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Morrison uses a workshop approach (after initial sessions focusing on 
different paradigms) where each student designs an evaluation proposal 
for a specific (and real) educational program, including specific data 
collection and analysis plans. Each section of the proposal is presented to 
a peer work group, who, along with the instructor, provides a detailed 
critique. The compieted proposal is submitted to a new group for a /resh 
critique of the proposal as a whole, and revised for summative evalution 
by the instructor. Students are also evaluated on their ability to provide 
helpful critiques of their colleague's work. The basic text for this section 
is Popham, Educational Evaluation supplemented with readings from 
journal articles and texts on research methods. 

Institutional Self-Study 

H.R. Kells (Rutgers) teaches a course titled, "Institutional Self-Study, 
Planning, and Evaluation in Postsecondary Education." This course is 
designed to describe the sources of control and models for evaluation, 
seif-regulation, accreditation, and institutional licensing processes in 
postsecondary education. Attention is also given to the elements of 
institutional self-study processes, institutional research, and planning 
models and processes. Students are expected to design an institutional 
self-study for a particular institution. Texts for this course are Jedamus 
and Peterson's, Improving Academic Management. Keller's, Academic 
Strategy, and Kells', Self-Studv Processes . 

Marvin Peterson (Michigan) teaches, "Institutional Research and 



ERIC 



9 



Research/Evaluation 
pages 



Planning," a course which examines the content, research methods, 
decision support systems, and the knowledge utilization strategies of 
institutional research. !n addition, the course focuses on the relationship 
of information technology, institutional research and institutional 
planning, and seeks to develop competencies in designing, critiquing and 
administering an institution's organizational intelligence and planning 
function. The pedagogical format includes field trips, guest speakers, 
readings, discussions, and modeling exercises. Students complete a 
project and a literature review of one area of the IR/planning literature. 
He uses the Hopkins and Massy (Planning Models for Colleges and 
UNiversitiesl Jedamus and Peterson (Improving Academic Management: A 
Handbook f or Planning and Institutional Research) texts supplemented by 
the New Directio ns for institutional Research monograph series. 
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Clearinghouse for Course Syllabi in Higher Education 



A group of Association for the Study of Higher Education (ASHE) members are forming a national higher education 
network for course syllabli. (See box.) The activity, sponsored by ASHE's Committee on Curriculum, Instruction 
and Learning, promises to be of great benefit to new and experienced teachers in higher education. 

If you wish to participate, please send your latest course syllabi to the appropriate members of the network today . 
These individuals have committed their time and effort toward the following: ' 

• syntheses reviewing course syllabi received with an evaluation of what is happening 
in each area (e.g., course titles, emphases, major works and resources in use, 
syllabi, models, trends, observations), along with a few exemplary syllabi to be 
made available via the ERIC Clearinghouse on Higher Education by the end of 1985 

• abstracts for inclusion in an essay on "Course Syllabi as Instructional Resources," 
to appear in the 1986 edition of ASHE's Instructional Resources Handbook for 
Higher Education 

• updates of the essay/abstract in four years. 



NETWORK MEMBERS 

Innovative/NontradU lonal 



Adult/Continuing Education 
College Students 
Community College 
Comparative/ International 
Current Issues 
Curriculum/ 1 obstruction 
Educational Policy 
Faculty Issues 
Finance 

Foundations/Hi story/Philosophy 
Governance 



K. Patricia Cross, Harvard Univ , Grad. school of 
Ed., 406 Gut nun Library, Cambridge, MA 02138 

Carol L. Everett, Penn State Univ., 304 Old Main, 
University Park, PA 16802 

Richard L. Alfred, University of Michigan, 2007 
School of Ed. Bldg, Ann Arbor, MI 46109 

Phillip G. Altbach. SUNY-Buffalo, Higher Education 
Program, 168 Ba'dy Hall, Buffalo. NY 14260 

Robert J. Silverman, Ohio State Univ., 301 Ramseyer 
Hall, 29 U. Woodruff Ave., Columbus, OH 43210 

Clifton F. Conrad, College of Education, Univ. 
of Arizona, 1415 *. Fremont, Tucson, AI 85719 

Patricia Crosson, Univ of Massachusetts-Amherst , 
tatters t. MA 01003 

Martin Finkelstein, Seton Hall Univ., McQuaid Hall, 
South Orange, NJ 07079 

Kern Alexander, University of Florida, Inst, for 
Ed. finance, Gainesville, FL 32611 

John Thelln, School of Education, 323 Jones Hall, 
College of William and Nary, Williamsburg, VA 23185 

John J. Gardiner, Oklahoma State Univ., 309 
Gunderson Hall, Stillwater, OK 74078 



Institutional Research/Planning 
Legal Issues 

Management Information Systems 
Organization/Administration 
Publ ic Pol icy 
Research/Evaluation 
Sociology 



Student Personnel Administration/ 
Counseling/Human Development 



Teacher Education 



Vocational/Technical 



Dlanne S. Peters. Montane State Univ.. 213 Re1d Kail, 
6oz«man. MT 59717 

Dennis Viehland, Ctr. for the Stuay ot Higher Ed., 
Univ. of Arlzont, 1415 N. Fremont, Tucson, A2 85719 

Michael A OHvas, Untv. of Houston, Inst, for Higher 
Ed. Law ft Gov., 415 Farlsh. Houston, TX 77004 

Fabert G. Cope, Univ of Washington, M219 Miller 
Hall, DQ-12, Seattle, MA 98195 

Ellen E«rle Chaffee, Board of Higher Education, 
Capitol Bldg., 19th Floor, Bismarck, ND 58505 

Jack H. Schuster, Claremont Graduate School, Higher 
Ed. Program, Claremont, CA 91711 

James L. Morrison, 120 ' ibooy Hall 037A, Univ. 
of North Carolina, P .pel Mill, NC 27514 

Zelda Gemson, RF II, Box 11A, Chilmart, KA 02535 
anu 

David S. Webster, Univ. of Pennsylvania, 3700 
Walnut St/Cl, Philadelphia. PA 19081 

Larry H. Ebbers, N244 Quadrangle, Iowa State 
Unl v. , fcnes, 1A 50011 

Jack Hruska, Univ. of Massachusetts , School of 
Education, Amherst, MA 01003 

Clyde Glnn, Univ. of Southern Mississippi, Boa 
5177, Southern Sta., Hattiesburg, MS 39406 




To establish a viable clearinghouse, your help is needed. Please flood members of the network with your course 
^ J syllabi and suggestions. Help establish a higher education clearinghouse for course syllabi. J 



